Image forming system, method of controlling image forming apparatus by using messenger application of mobile device, and the mobile device for performing the method

ABSTRACT

An image forming system to control an image forming apparatus by using a messenger application, a mobile device, and a method are provided. The image forming system includes a mobile device to activate a chat user interface to interface with an account of the image forming apparatus on the messenger application, and sending user messages to control a printing function of the image forming apparatus, a cloud server to receive the user messages from a messenger server, providing response messages of the account of the image forming apparatus in response to the user messages, and communicating with the mobile device in a conversational manner, thus controlling the printing of the image forming apparatus, and an image forming apparatus whose printing is controlled by the cloud server based on the user messages or providing monitoring information of a current status.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is related to, and claims the priority benefit of,Korean Patent Application No. 10-2013-0156641, filed on Dec. 16, 2013,in the Korean Intellectual Property Office, the disclosure of which isincorporated herein in its entirety by reference.

BACKGROUND

1. Field

One or more embodiments relate to a method of controlling an imageforming apparatus by using a message application of a mobile device, anda mobile device to perform the method.

2. Description of the Related Art

Users communicate by using, for example, a home page, an e-mail, etc. asvarious information transfer media. However, users may not communicatewith a target user in real time using such forms of communication. Aninstant messenger (i.e., a messenger) may be useful for transferringinformation in real time via the Internet. The instant messengerattempts to transfer a simple message between users in real time. Whenthe messenger is used, two users may chat in real time through textstransferred, as if they personally converse with each other. As themessenger instantly transfers input content of a message, the real-timefeature of the message is regarded as being important. A messengerapplication may provide a function of transmitting emoticons, flashcons,giftcons, etc. to a conversation participant through a conversationwindow or a chat window or a function of transmitting a file using theconversation window as well as transferring a message.

SUMMARY

One or more embodiments include a method of controlling an image formingapparatus by using a message application of a mobile device, and themobile device to perform the method.

One or more embodiments include a computer-readable recording mediumhaving recorded thereon a program for executing the method.

Additional aspects will be set forth in part in the description whichfollows and, in part, will be apparent from the description, or may belearned by practice of the presented embodiments.

According to one or more embodiments, a mobile device to control animage forming apparatus by using a messenger application includes a userinterface unit to activate a chat user interface to interface with anaccount of the image forming apparatus corresponding to the imageforming apparatus on the messenger application, a network interface unitto send user messages to control a printing function of the imageforming apparatus, which are input through the activated chat userinterface, and a control unit to control the printing function of theimage forming apparatus by communicating with the image formingapparatus in a conversational manner according to response messages ofthe account of the image forming apparatus in response to the input usermessages.

According to one or more embodiments, a method of controlling an imageforming apparatus by using a messenger application of a mobile deviceincludes activating a chat user interface to interface with an accountof the image forming apparatus corresponding to the image formingapparatus on the messenger application, sending user messages to controla printing function of the image forming apparatus, which are inputthrough the activated chat user interface; and controlling the printingfunction of the image forming apparatus by communicating with the imageforming apparatus in a conversational manner according to responsemessages of the account of the image forming apparatus in response tothe input user messages.

According to one or more embodiments, a non-transitory computer-readablerecording medium having embodied thereon a program for executing themethod described above is included.

According to one or more embodiments, a image forming system to controlan image forming apparatus by using a messenger application includes amobile device to activate a chat user interface to interface with anaccount of the image forming apparatus on the messenger application, andsending user messages to control a printing function of the imageforming apparatus, a cloud server to receive the user messages from amessenger server, providing response messages of the account of theimage forming apparatus in response to the user messages, andcommunicating with the mobile device in a conversational manner, thuscontrolling the printing function of the image forming apparatus, and animage forming apparatus whose printing function is controlled by thecloud server based on the user messages or providing monitoringinformation of a current status.

BRIEF DESCRIPTION OF THE DRAWINGS

These and/or other aspects will become apparent and more readilyappreciated from the following description of the embodiments, taken inconjunction with the accompanying drawings in which:

FIG. 1A illustrates an image forming system according to an embodiment;

FIG. 2A illustrates a hardware configuration of a cloud server accordingto an embodiment;

FIG. 2B illustrates a communication method preformed between a botserver and a messenger server according to an embodiment;

FIG. 2C is a table illustrating an action map used to parse a usermessage in a bot server according to an embodiment;

FIGS. 3A and 3B illustrate a registration of identification informationof an image forming apparatus and a user to a print service serveraccording to an embodiment;

FIG. 4 illustrates a hardware configuration of a mobile devicesaccording to an embodiment;

FIG. 5 illustrates a user interface (UI) screen that converses with animage forming apparatus by using a messenger application of a mobiledevice according to an embodiment;

FIGS. 6A and 6B illustrate a process of controlling a printing functionof an image forming apparatus by using a messenger application of amobile device, which is performed in an image forming system accordingto an embodiment;

FIGS. 7A and 7B illustrate a process of managing a status of an imageforming apparatus by using a messenger application of a mobile device,which is performed in an image forming system according to anembodiment;

FIG. 8 illustrates a method of receiving monitoring information of astatus of an image forming apparatus by using a messenger application ofa mobile device according to an embodiment;

FIG. 9 is a flowchart of a method of controlling an image formingapparatus by using a messenger application of a mobile device accordingto an embodiment;

FIG. 10 is a flowchart of a method of managing a printing function of animage forming apparatus by using a messenger application of a mobiledevice according to an embodiment; and

FIG. 11 is a flowchart of a method of managing a status of an imageforming apparatus by using a messenger application of a mobile deviceaccording to an embodiment.

DETAILED DESCRIPTION

Reference will now be made in detail to embodiments, examples of whichare illustrated in the accompanying drawings, wherein like referencenumerals refer to like elements throughout. The present embodiments mayhave different forms and should not be construed as being limited to thedescriptions set forth herein. Accordingly, the embodiments are merelydescribed below, by referring to the figures, to explain aspects of thepresent description. As used herein, the term “and/or” includes any andall combinations of one or more of the associated listed items.

FIG. 1A illustrates an image forming system 1 according to anembodiment. Referring to FIG. 1, a mobile device 10, a message server20, a cloud server 30, and an image forming apparatus 40 are provided tothe image forming system 1.

Although the mobile device 10, the message server 20, the cloud server30, and the image forming apparatus 40 are provided to the image formingsystem 1 of FIG. 1, for convenience of description, the presentembodiment is not limited thereto. One or more various types of mobiledevices 10, message servers 20, cloud servers 30, and image formingapparatuses 40 may be provided.

In other words, exemplary hardware components are illustrated in ordernot to obscure the characteristics of the embodiment in FIG. 1. However,it will be understood by one of ordinary skill in the art thatgeneral-use hardware components, for example, an access point (AP), anetwork hub, etc., other than the hardware components shown in FIG. 1,may also be provided.

The image forming apparatus 40 may be an individual device, such as aprinter, a scanner, a copier, or a facsimile, or the like, or maycorrespond to a multifunction product (MFP) that incorporates variousfunctions of the above different devices into one device.

The mobile device 10 may correspond to a device, such as a smart phone,a tablet device, a personal digital assistant (PDA), a notebook, apersonal computer (PC), or the like.

The mobile device 10 may correspond to a device in which commercialmessenger applications, such as Kakao Talk, WhatsApp, FacebookMessenger, and the like, may be installed.

The messenger server 20 may correspond to a server that is run by aprovider to provide types of commercial messenger applications.

The cloud server 30, which is a server that manages the image formingapparatus 40, mediates messages transmitted and received between theimage forming apparatus 40 and the mobile device 10 via the messengerserver 20.

Each of the mobile devices 10, the message servers 20, the cloud servers30, and the image forming apparatuses 40 that are provided to the imageforming system 1 may have wired and/or wireless communication functions.Thus, each of the mobile devices 10, the message servers 20, the cloudservers 30, and the image forming apparatuses 40 may utilize the wiredand/or wireless communication functions that are supported by a deviceitself to form a wired and/or wireless network that is connected to eachother. That is, as long as the image forming system 1 connected over thewired and/or wireless network is established, it will be understood byone of ordinary skill in the art that various y wired or wirelessnetworks may be used.

When the mobile device 10 executes the messenger application in theimage forming system 1, the mobile device 10 may control the imageforming apparatus 40 by using a chatting method of conversing bytransmitting/receiving messages between a user's account and an accountof the image forming apparatus 40 corresponding to the image formingapparatus 40 through the executed messenger application. The imageforming apparatus 40 pushes and provides information regarding a currentstatus of the image forming apparatus 40 to the messenger application ofthe mobile device 10 in a message form, and thus a user of the mobiledevice 10 may more easily manage the current status of the image formingapparatus 40.

FIG. 2A illustrates the cloud server 30 according to an embodiment.Referring to FIG. 2A, the cloud server 30 includes a bot server 310 anda print service server 330.

The bot server 310 communicates with the messenger server 20 thatprovides a service relating to a messenger application to transmit andreceive messages.

The image forming apparatus 40 may not actively compose a message like auser, because the image forming apparatus 40, itself, is a machine.Thus, the bot server 310 parses user messages transmitted from themobile device 10 by using an account of the image forming apparatus 40corresponding to the image forming apparatus 40, and generate responsemessages of the account of the image forming apparatus 40 correspondingto the user messages. That is, the bot server 310 automatically feedsback the response messages to the user messages in place of the imageforming apparatus 40 by using a messenger application of the mobiledevice 10.

FIG. 2B illustrates a communication method preformed between the botserver 310 and the messenger server 20 according to an embodiment.Referring to FIG. 2B, the messenger server 20 includes various types ofinterface 200 to communicate with the bot server 310.

A bot server registration configuration 201 of the messenger server 20registers and manages the bot server 310 to be identified with themessenger server 20.

A relay interface configuration 202 and a request received messageconfiguration 203 are divided according to which communication method isto be applied to the bot server 310.

The messenger server 20 provides a way by which the bot server 310corresponding to a 3rd party approaches.

The messenger server 20 includes the relay interface configuration 202so that the messenger server 20 may send, e.g., automatically send auser message transmitted from a messenger application of the mobiledevice 10 to an implement relay interface configuration 311 of the botserver 310.

The messenger server 20, which is an open application programminginterface (API), may respond to a message according to a request of areceive message fetcher configuration 312. The bot server 310 leadinglyoperates as a fetcher that fetches the user message received by themessenger server 20.

When the user message is sent from the messenger server 20 to the botserver 310 as described above, the bot server 310 parses the usermessage and internally generates a response message in response to theuser message. A message sender configuration 313 of the bot server 310calls the open API of the messenger server 20 to send the responsemessage to a send message configuration 204 of the messenger server 20,so that the messenger server 20 is requested to send the responsemessage to the messenger application of the mobile device 10.

FIG. 2C is a table illustrating an action map used to parse a usermessage in the bot server 310 according to an embodiment.

The bot server 310 separates texts included in the user message sentfrom the messenger server 20 according to words. The words separatedfrom the texts correspond to tokens. The tokens may be mapped to actionsdefined in the action map.

For example, when a token “

” or “printer” is included in the texts included in the user message,the bot server 310 parses the token to be mapped to an action “PRINTER”.When a token “

” is included in the texts included in the user message, the bot server310 parses the token to be mapped to an action “SEARCH”.

In other words, the bot server 310 construes meaning of the textsincluded in the user message, and a user converts the meaning into acontrol command for the image forming apparatus 40.

FIG. 2C illustrates exemplary tokens and actions. In addition to theaction map of FIG. 2C, various tokens and actions may be provided.

Referring to FIG. 2A, the print service server 330 controls and managesthe image forming apparatus 40 provided to the image forming system 1.Although only one image forming apparatus 40 is provided in the presentembodiment for convenience of description, various image formingapparatuses may be provided to the image forming system 1, other thanthe image forming apparatus 40. That is, the print service server 330may control and manage all image forming apparatuses provided to theimage forming system 1.

The print service server 330 registers identification information of theimage forming apparatus 40 provided to the image forming system 1 tocontrol an operation of the image forming apparatus 40. The printservice server 330 maps and registers user identification informationwith respect to information regarding the image forming apparatus 40.

FIGS. 3A and 3B illustrate a registration of identification informationof the image forming apparatus 40 and a user to the print service server330 according to an embodiment.

Referring to FIG. 3A, the user may access a web page 301 provided by anembedded web server of the image forming apparatus 40 to register theidentification information of the image forming apparatus 40 and theuser.

The user may input their e-mail address and information regarding theimage forming apparatus 40 that are to be registered by using the webpage 301. That is, for example, the user may input their e-mail address“jaeyoung.soh@samsung.com” and designate “Printer A (R4 19F)” as theimage forming apparatus 40 that is to be mapped to the e-mail address“jaeyoung.soh@samsung.com”.

When the user clicks a registration button on the web page 301, the usermaps and registers information regarding the e-mail address“jaeyoung.soh@samsung.com” and the image forming apparatus 40 “Printer A(R4 19F)” to the print service server 330 as user management information331 and printer management information 333, respectively.

The user may register user identification information by using a userinterface (UI) panel 302 of the image forming apparatus 40.

The user may input information regarding their e-mail address in theimage forming apparatus 40 “Printer A (R4 19F)”. That is, for example,when the user inputs their e-mail address “jaeyoung.soh@samsung.com” andclicks the registration button, the information regarding the e-mailaddress “jaeyoung.soh@samsung.com” and the image forming apparatus 40“Printer A (R4 19F)” may be mapped and registered to the print serviceserver 330 as the user management information 331 and the printermanagement information 333, respectively.

Referring to FIG. 2A, the print service server 330 may control the imageforming apparatus 40 or manage a status of the image forming apparatus40 according to actions that are indicated by user messages parsed bythe bot server 310.

For example, when the actions that are indicated by the user messagesparsed by the bot server 310 correspond to the actions “PRINTER” and“SEARCH”, the print service server 330 may return a list of imageforming apparatuses that are currently connected to a network of theimage forming system 1 back to the bot server 310.

Alternatively, when the actions that are indicated by the user messagesparsed by the bot server 310 correspond to an action “PRINT”, the printservice server 330 may control the image forming apparatus 40 to performa printing function.

When the actions that are indicated by the user messages parsed by thebot server 310 correspond to the action “PRINT”, the print serviceserver 330 may perform rendering for generating printing data as a cloudprinting function, and send the rendered printing data to the imageforming apparatus 40.

Alternatively, when the actions that are indicated by the user messagesparsed by the bot server 310 correspond to actions “RESOURCE” and“CHECK”, the print service server 330 may return information regardingan amount of toner currently remaining in the image forming apparatus 40back to the bot server 310.

That is, the messenger server 20, the cloud server 30, and the imageforming apparatus 40 process the user messages transmitted from themobile device 10 and send response messages in response to the usermessages to the mobile device 10 again, in order to allow a user accountand an account of the image forming apparatus 40 to automaticallyconverse with each other on the messenger application.

FIG. 4 is a block diagram of a detailed hardware configuration of themobile devices 10 according to an embodiment.

Referring to FIG. 4, the mobile device 10 includes a user interface unit110, a control unit 120, and a network interface unit 130 according toan embodiment. However, it will be understood by one of ordinary skillin the art that general-use hardware components, other than the hardwarecomponents shown in FIG. 4, may also be provided.

The user interface unit 110, which is a hardware component including aninput apparatus or a display apparatus, displays information to a userof the mobile device 10 or receives information from the user. The userinterface unit 110 may include some or all individual apparatuses thatinterface with the user, such as a display screen, a speaker, a key pad,a keyboard, a mouse, and the like, and may also include a touch screen,etc.

The user may execute a messenger application via the user interface unit110. The user interface unit 110 displays information displayed by theexecuted messenger application to the user. The user may input messagesto the messenger application via the user interface unit 110 to chatwith other users or an account of the image forming apparatus 40.

The control unit 120 is a hardware component that controls a generaloperation and function of the mobile device 10. The control unit 120controls an execution of the message application installed in the mobiledevice 10.

The control unit 120 may be implemented as at least one processor, suchas a central processing unit (CPU), an application processor (AP), etc.

The network interface unit 130 that may support wired communication, 2Gmobile communication, 3G mobile communication, 4G mobile communication,etc. is a hardware component that supports a wired or wirelesscommunication function. The network interface unit 130 may supportwireless communication, such as Wi-Fi, Wi-Fi Direct, near fieldcommunication (NFC), Bluetooth, etc., and wired communication, 2G mobilecommunication, 3G mobile communication, 4G mobile communication, etc.via Ethernet.

An operation of the mobile device 10 of exemplary embodiment isdescribed in more detail below.

The user interface unit 110 displays the messenger application executedby the control unit 120.

When the user requests that a chat window with an account of the imageforming apparatus 40 corresponding to the image forming apparatus 40 beopened on the messenger application, the user interface unit 110activates a chat UI to interface with the account of the image formingapparatus 40 on the messenger application.

The activated chat UI may correspond to a chat window for chatting withthe account of the image forming apparatus 40 one-to-one. Alternatively,the activated chat UI may correspond to a chat window for chatting withthe cloud server 30 that manages the account of the image formingapparatus 40 and accounts of other image forming apparatuses.Alternatively, the activated chat UI may correspond to a group chatwindow for chatting with each of the accounts of other image formingapparatuses one-to-N (where N is a natural number equal to or greaterthan 2).

The network interface unit 130 sends user messages to control a printingfunction of the image forming apparatus 40 that are input via theactivated chat UI. The messenger application may correspond to anapplication provided by the messenger server 20 as described above, andthus the user messages may be preferentially sent to the messengerserver 20.

For example, when a message including an image that is to be printed isinput via the activated chat UI, the network interface unit 130 sendsthe image that is to be printed to the image forming apparatus 40. Theimage that is to be printed may be sent to the image forming apparatus40 via the messenger server 20 and the cloud server 30.

The control unit 120 communicates with the image forming apparatus 40,for example, in a conversational manner according to response messagesof the account of the image forming apparatus 40 in response to theinput user messages, thereby controlling the printing function of theimage forming apparatus 40.

The account of the image forming apparatus 40 may be managed by the botserver 310. The response messages may be generated by the bot server 310and sent to the mobile device 10.

That is, the user messages and the response messages may be transmittedand received via mediation of the cloud server 30 that manages the imageforming apparatus 40.

FIG. 5 illustrates a UI screen that converses with the image formingapparatus 40 by using a messenger application of the mobile device 10according to an embodiment.

Referring to FIG. 5, Printer A and a chat window are activated in themobile device 10 that is currently executing a messenger application.

A user may input a user message “printer search” via the user interface110 to send the user message “printer search” to an account of PrinterA.

The input user message “printer search” may be sent to the messengerserver 20 via the network interface unit 130. The messenger server 20,as described with reference to FIG. 2B above, sends the user message“printer search” to the bot server 310.

The bot server 310 parses and converts the user message “printer search”into actions corresponding to the user message “printer search” by usingthe action map, for example, of FIG. 2C.

The print service server 330 collects information regarding Printer Aand Printer B that are currently connected to the print service server330, for example, based on the actions “PRINTER” and “SEARCH”corresponding to the user message “printer search”.

The print service server 330 transmits the information regarding thePrinter A and Printer B to the bot server 310. The bot server 310returns a response message such as “Select a printer. 1. Printer A(19F)2. Printer B(35F)” based on the information regarding the Printer A andPrinter B back to the mobile device 10 via the messenger sever 20.

When the response message regarding a list of image forming apparatusesis returned, the user may select a desired object from the list of imageforming apparatuses. For example, the user may input a user message “1”via the user interface unit 110 to select Printer A.

Thereafter, the messenger server 20, the bot server 3310, and the printservice server 330 send a message of an image that was sent from theuser and is to be printed to the image forming apparatus 40 “Printer A”,to allow the image forming apparatus 40 to perform a printing functionwith respect to the image.

The messenger server 20, the bot server 3310, and the print serviceserver 330 may additionally send response messages that guide a printingprocess to the mobile device 10 during the printing process. The userinterface unit 110 may display the response messages on the messengerapplication.

FIGS. 6A and 6B illustrate a process of controlling a printing functionof the image forming apparatus 40 by using a messenger application ofthe mobile device 10, which is performed in the image forming system 1according to an embodiment.

Referring to 6A and 6B, a user of the mobile device 10 uses an e-mailaddress “sadman@samsung.com”, and a user of a mobile device 13 uses ane-mail address “kasey@samsung.com”.

Printer A (the image forming apparatus 40), for example, may be alreadyregistered to the print service server 330. Printer B (not shown), forexample, may be already registered to the print service server 330.

In operation 601, the mobile device 10 receives a user message “printersearch” from the user. The user message “printer search” is sent to themessenger server 20 via the network interface unit 130. The messengerserver 20 sends the user message “printer search” to the bot server 310.

In operation 602, the bot server 310 parses and converts the usermessage “printer search” into actions corresponding to the user message“printer search” by using the action map of FIG. 2C.

The bot server 310 converts a response message that inquires about whoseuser account is used to log in to the messenger server 20 beforetransferring the actions “PRINTER” and “SEARCH” corresponding to theuser message “printer search” to the print service server 330. Themessenger server 20 sends a response message “let us know an account tobe used” to the mobile device 10.

In operation 603, the mobile device 10 receives a user message of a useraccount “kasey@samsung.com” from the user. The user message of the useraccount “kasey@samsung.com” is sent to the messenger server 20 via thenetwork interface unit 130. The messenger server 20 sends the usermessage of the user account “kasey@samsung.com” to the bot server 310.

In operation 604, the bot server 310 requests the print service server330 to transfer a list of image forming apparatuses that are to bemapped to the user account “kasey@samsung.com”. The print service server330 returns information regarding the list of Printer A (the imageforming apparatus 40) and Printer B (not shown) that are currentlyconnected to the print service server and are mapped to“kasey@samsung.com” back to the bot server 310.

In operation 605, the bot server 310 returns a response message such as“Select a printer. 1. Printer A(19F) 2. Printer B(35F)” based on theinformation regarding the list of the Printer A and Printer B back tothe messenger sever 20. The messenger server 20 sends the responsemessage such as “Select a printer. 1. Printer A(19F) 2. Printer B(35F)”to the mobile device 10.

In operation 606, the mobile device 10 receives a user message “1” forselecting Printer A (the image forming apparatus 40) from the user. Theuser message “1” is sent to the messenger server 20 via the networkinterface unit 130. The messenger server 20 sends the user message “1”to the bot server 310.

In operation 607, the bot server 310 parses and converts the usermessage “1” into actions corresponding to the user message “1” by usingthe action map of FIG. 2C.

The bot server 310 returns a response message indicating that an action“SELECTION” corresponding to the user message “1” is determined to themessenger server 20. The messenger server 20 sends a response message“Printer A is selected. Send contents to be printed” to the mobiledevice 10.

In operation 608, the mobile device 10 receives a user message regardingan image that is to be printed from the user. The user message includingthe image is sent to the messenger server 20 via the network interfaceunit 130. The messenger server 20 sends the user message including theimage to the bot server 310.

In operation 609, the print service server 330 returns informationregarding the user account “kasey@samsung.com” back to the bot server310. This is because the user account (sadman@samsung.com) of the mobiledevice 10 may be different from the user account (“kasey@samsung.com)mapped to the Printer A. Thus, authentication of the mobile device 13having the user account (“kasey@samsung.com) may be required.

In operation 610, the bot server 310 returns a response message “Waitingfor use authentication of Printer A” informing that authentication ofthe mobile device 13 is required back to the messenger server 20. Themessenger server 20 sends the response message “Waiting for useauthentication of Printer A” to the mobile device 10.

In operation 611, the bot server 310 returns a response message “Sadmanrequested for printing of Printer A. Will you accept? 1. Yes 2. No”informing that authentication of the mobile device 13 is required backto the messenger server 20. The messenger server 20 sends the responsemessage “Sadman requested for printing of Printer A. Will you accept? 1.Yes 2. No” to the mobile device 13 having the user account(“kasey@samsung.com).

In operation 612, the mobile device 13 receives the user message “1” forauthenticating use of Printer A (the image forming apparatus 40) fromanother user. The user message “1” is sent to the messenger server 20via the network interface unit 130. The messenger server 20 sends theuser message “1” to the bot server 310.

In operation 613, Printer A is completely authorized by the user of themobile device 13, and thus the bot server 310 transmits the image thatis to be printed to the print service server 330.

The print service server 330 renders the image that is to be printed togenerate and transmit printing data to Printer A (the image formingapparatus 40).

Printer A (the image forming apparatus 40) performs the printingfunction thereof based on the printing data, thereby printing the image.

In operation 614, the image is completely printed by Printer A (theimage forming apparatus 40), and thus the bot server 310 returns aresponse message “Authenticated. Printing is complete.” back to themessenger server 20. The messenger server 20 sends the response message“Authenticated. Printing is complete.” to the mobile device 13.

Through operations 601 through 614 above, the mobile device 10 maycontrol the printing function of Printer A (the image forming apparatus40) for printing the image by using the messenger application.

FIGS. 7A and 7B illustrate a process of managing a status of the imageforming apparatus 40 by using a messenger application of the mobiledevice 10, which is performed in the image forming system 1 according toan embodiment.

Referring to 7A and 7B, a user of the mobile device 10 uses an e-mailaddress “kasey@samsung.com”.

Printer A (the image forming apparatus 40) is already registered to theprint service server 330. Printer B (not shown) is already registered tothe print service server 330.

In operation 701, the mobile device 10 receives a user message “printersearch” from the user. The user message “printer search” is sent to themessenger server 20 via the network interface unit 130. The messengerserver 20 sends the user message “printer search” to the bot server 310.

In operation 702, the bot server 310 parses and converts the usermessage “printer search” into actions corresponding to the user message“printer search” by using the action map of FIG. 2C.

The bot server 310 converts a response message that inquires about whoseuser account is used to log in to the messenger server 20 beforetransferring the actions “PRINTER” and “SEARCH” corresponding to theuser message “printer search” to the print service server 330. Themessenger server 20 sends a response message “let us know an account tobe used” to the mobile device 10.

In operation 703, the mobile device 10 receives a user message of a useraccount “kasey@samsung.com” from the user. The user message of the useraccount “kasey@samsung.com” is sent to the messenger server 20 via thenetwork interface unit 130. The messenger server 20 sends the usermessage of the user account “kasey@samsung.com” to the bot server 310.

In operation 704, the bot server 310 requests the print service server330 to transfer a list of image forming apparatuses that are to bemapped to the user account “kasey@samsung.com”. The print service server330 returns information regarding the list of Printer A (the imageforming apparatus 40) and Printer B (not shown) that are currentlyconnected to the print service server 330 and are mapped to“kasey@samsung.com” back to the bot server 310.

In operation 705, the bot server 310 returns a response message such as“Select a printer. 1. Printer A(19F) 2. Printer B(35F)” based on theinformation regarding the list of the Printer A (the image formingapparatus 40) and Printer B back to the messenger sever 20. Themessenger server 20 sends the response message such as “Select aprinter. 1. Printer A(19F) 2. Printer B(35F)” to the mobile device 10.

In operation 706, the mobile device 10 receives a user message “1” forselecting Printer A (the image forming apparatus 40) from the user. Theuser message “1” is sent to the messenger server 20 via the networkinterface unit 130. The messenger server 20 sends the user message “1”to the bot server 310.

In operation 707, the bot server 310 parses and converts the usermessage “1” into actions corresponding to the user message “1” by usingthe action map of FIG. 2C.

The bot server 310 returns a response message indicating that an action“SELECTION” corresponding to the user message “1” is determined to themessenger server 20. The messenger server 20 sends a response message“Printer A is selected.” to the mobile device 10.

In operation 708, the bot server 310 requests the print service server330 for information regarding a status of Printer A (the image formingapparatus 40). The print service server 330 returns informationindicating that Printer A (the image forming apparatus 40) is currentlya paper shortage and a paper jam, has occurred back to the bot server310.

In operation 709, the bot server 310 returns a response message “thereis no paper” to the messenger server 20. The messenger server 20 sendsthe response message “there is no paper” to the mobile device 10.

Accordingly, the user supplies more paper to Printer A (the imageforming apparatus 40), thereby managing the status of Printer A (theimage forming apparatus 40).

In operation 710, the bot server 310 returns a response message “jam hasoccurred” back to the messenger server 20. The messenger server 20 sendsthe response message “jam has occurred” to the mobile device 10.

Accordingly, the user removes a jammed paper from Printer A (the imageforming apparatus 40), thereby managing the status of Printer A (theimage forming apparatus 40).

In operation 711, the mobile device 10 receives a user message “Checktoner status” from the user. The user message “Check toner status” issent to the messenger server 20 via the network interface unit 130. Themessenger server 20 sends the user message “Check toner status” to thebot server 310.

The bot server 310 parses and converts the user message “Check tonerstatus” into the actions “RESOURCE” and “CHECK” corresponding to theuser message “Check toner status” by using the action map of FIG. 2C.

In operation 712, the bot server 310 requests the print service server330 for information regarding a toner status of Printer A (the imageforming apparatus 40). The print service server 330 returns informationindicating that 90% of black toner currently remains in Printer A (theimage forming apparatus 40) back to the bot server 310.

In operation 713, the bot server 310 returns a response message “90% ofblack is remaining” to the messenger server 20. The messenger server 20sends the response message “90% of black is remaining” to the mobiledevice 10.

Accordingly, the user determines the toner status of Printer A (theimage forming apparatus 40), thereby managing the status of Printer A(the image forming apparatus 40).

In operation 714, the mobile device 10 receives a user message “Checkfax status” from the user. The user message “Check fax status” is sentto the messenger server 20 via the network interface unit 130. Themessenger server 20 sends the user message “Check fax status” to the botserver 310.

The bot server 310 parses and converts the user message “Check faxstatus” into the actions “FAX” and “CHECK” corresponding to the usermessage “Check fax status” by using the action map of FIG. 2C.

In operation 715, the bot server 310 requests the print service server330 for information regarding a fax status of Printer A (the imageforming apparatus 40). The print service server 330 returns informationindicating that a fax function of Printer A (the image forming apparatus40) is currently deactivated back to the bot server 310.

In operation 716, the bot server 310 returns a response message “faxfunction is off” to the messenger server 20. The messenger server 20sends the response message “fax function is off” to the mobile device10.

Accordingly, the user determines the fax status of Printer A (the imageforming apparatus 40), thereby managing the status of Printer A (theimage forming apparatus 40).

Through operations 710 through 716 stated above, the mobile device 10may manage the status of Printer A (the image forming apparatus 40) byusing the messenger application.

FIG. 8 illustrates a method of receiving monitoring information of astatus of the image forming apparatus 40 by using a messengerapplication of the mobile device 10 according to an embodiment.

Referring to FIG. 8, Printer A (the image forming apparatus 40) may pusha message indicating monitoring information to the messenger applicationof the mobile device 10. For example, when Printer A (the image formingapparatus 40) is short of black toner, Printer A (the image formingapparatus 40) may send a push message “4% of black toner currentlyremains in Printer A” to the mobile device 10. That is, the monitoringinformation of a status of Printer A (the image forming apparatus 40)may be pushed to the mobile device 10 by using the messenger applicationlike a message sent from an outside individual.

In other words, the print service server 330 may transfer the monitoringinformation of the status of Printer A (the image forming apparatus 40)to the bot server 310 regularly or when an event occurs in Printer A(the image forming apparatus 40). Accordingly, the bot server 310 maysend the message including the monitoring information to the mobiledevice 10 via the messenger server 20.

FIG. 9 is a flowchart of a method of controlling the image formingapparatus 40 by using a messenger application of the mobile device 10according to an embodiment.

In operation 901, the user interface unit 110 of the mobile device 10activates a chat UI to interface with an account of the image formingapparatus 40 corresponding to the image forming apparatus 40 on themessenger application.

In operation 902, the network interface unit 130 of the mobile device 10sends user messages to control a printing function of the image formingapparatus 40 that are input through the activated chat UI.

In operation 903, the control unit 120 of the mobile device 10communicates with the image forming apparatus 40 in a conversationalmanner according to response messages of the account of the imageforming apparatus 40 in response to the input user messages, therebycontrolling the printing function of the image forming apparatus 40.

FIG. 10 is a flowchart of a method of managing a printing function ofthe image forming apparatus 40 by using a messenger application of themobile device 10 according to an embodiment.

In operation 1001, a user inputs a user message to the messengerapplication of the mobile device 10.

In operation 1002, the messenger server 20 automatically sends the usermessage to the bot server 310, as illustrated, for example, by path 2000of FIG. 2B.

Alternatively, in operation 1003, the bot server 310 inquires whetherthe messenger server 20 currently receives a message from the mobiledevice 10, as illustrated, for example, by path 3000 of FIG. 2B. If themessenger server 20 currently receives the message from the mobiledevice 10, operation 1004 is performed.

Both operations 1002 and 1003, or one of them may be performed accordingto types of interfaces of the messenger server 20 and the bot server310.

In operation 1004, the bot server 310 parses the user message. The botserver 310 may parse texts included in the user message as tokens.

In operation 1005, the bot server 310 designates actions correspondingto the user message by using an action map. The bot server 310 may mapthe tokens parsed from the user message to the actions by using theaction map.

In operation 1006, the bot server 310 determines whether the usermessage is a printing command. If the user message is the printingcommand, operation 1007 is performed. However, if the user message doesnot mean the printing command, operation A of FIG. 11 is performed.

In operation 1007, the bot server 310 determines whether the usermessage includes an image that is to be printed. If the user messageincludes the image, operation 1008 is performed. However, if the usermessage does not include the image, operation 1001 is performed again inorder to input a user message including the image.

In operation 1008, the print service server 330 renders the imageincluded in the user message to generate printing data. That is, theprint service server 330 performs cloud rendering.

In operation 1009, the image forming apparatus 40 prints the image byusing the generated printing data.

FIG. 11 is a flowchart of a method of managing a status of the imageforming apparatus 40 by using a messenger application of the mobiledevice 10 according to an embodiment.

In operation 1101, the bot server 310 determines whether a user messageis a message that requests monitoring information. If the user messageis the message that requests the monitoring information, operation 1102is performed. If not, operation 1105 is performed.

In operation 1102, the print service server 330 monitors the status ofthe image forming apparatus 40 to collect the monitoring information.

In operation 1103, the bot server 310 generates a response messageincluding current monitoring information based on the collectedmonitoring information.

In operation 1104, the bot server 310 generates a response message thatguides or explains actions mapped by using an action map as a result ofparsing the user message.

In operation 1105, the bot server 310 sends the response message to themessenger server 20, and the messenger server 20 sends the responsemessage to the mobile device 10.

According to the one or more embodiments, various types of commercialmessenger applications that are installed in a mobile device may be usedto control a printing function of an image forming apparatus or monitorinformation regarding a status of the image forming apparatus by using amethod of chatting with the image forming apparatus, thereby moreconveniently and intuitively utilizing a function of the image formingapparatus or managing the image forming apparatus.

In addition, an exemplary embodiment may be implemented through computerreadable code/instructions in/on a medium, e.g., a computer readablemedium, to control at least one processing element to implement anyabove described embodiment. The medium can correspond to anothermedium/media permitting the storage and/or transmission of the computerreadable code. The computer readable code can be recorded/transferred ona medium in a variety of ways, with examples of the medium includingrecording media, such as magnetic storage media (e.g., ROM, floppydisks, hard disks, etc.) and optical recording media (e.g., CD-ROMs, orDVDs), and transmission media such as Internet transmission media.

It should be understood that the exemplary embodiments described hereinshould be considered in a descriptive sense only and not for purposes oflimitation. Descriptions of features or aspects within each embodimentshould typically be considered as available for other similar featuresor aspects in other embodiments.

While one or more embodiments have been described with reference to thefigures, it will be understood by those of ordinary skill in the artthat various changes in form and details may be made therein withoutdeparting from the spirit and scope as defined by the following claims.

What is claimed is:
 1. A mobile device to control an image formingapparatus by using a messenger application, the mobile devicecomprising: a user interface unit to activate a chat user interface tointerface with an account of the image forming apparatus correspondingto the image forming apparatus on the messenger application; a networkinterface unit to send user messages to control a printing function ofthe image forming apparatus, which are input through the activated chatuser interface; and a control unit to control the printing function ofthe image forming apparatus by communicating with the image formingapparatus in a conversational manner according to response messages ofthe account of the image forming apparatus in response to the input usermessages.
 2. The mobile device of claim 1, wherein the user messages andthe response messages are transmitted and received via a cloud serverthat manages the image forming apparatus.
 3. The mobile device of claim2, wherein the cloud server comprises a bot server that communicateswith a messenger server providing a service relating to the messengerapplication and sends and receives the user and response messages. 4.The mobile device of claim 3, wherein the bot server receives the usermessages from the messenger server and parses the received user messagesto generate the response messages corresponding to the received usermessages.
 5. The mobile device of claim 2, wherein the cloud servercomprises a print service server that controls and manages the imageforming apparatus present on a network.
 6. The mobile device of claim 5,wherein the print service server controls the printing function of theimage forming apparatus to be activated based on the user messages. 7.The mobile device of claim 5, wherein the print service server collectsmonitoring information of a status of the image forming apparatus basedon the user messages.
 8. The mobile device of claim 1, wherein thenetwork interface unit transmits an image that is to be printed to theimage forming apparatus when a message comprising the image that is tobe printed is input through the activated chat user interface.
 9. Themobile device of claim 1, wherein the activated chat user interface is achat window for chatting with the account of the image forming apparatusone-to-one.
 10. The mobile device of claim 1, wherein the activated chatuser interface is a chat window for chatting with a cloud server thatmanages the account of the image forming apparatus and accounts of otherimage forming apparatuses.
 11. The mobile device of claim 10, whereinthe user interface unit displays a response message comprising a list ofimage forming apparatuses that are being managed by the cloud server onthe activated chat user interface when a user message that explores alist of image forming apparatuses present on a network is input.
 12. Themobile device of claim 1, wherein the user interface unit displaysresponse messages indicating information regarding a management statusof the image forming apparatus or an operating status thereof on theactivated chat user interface.
 13. The mobile device of claim 1, whereinthe messenger application comprises a commercial application provided bya messenger server that provides a messenger service.
 14. A method ofcontrolling an image forming apparatus by using a messenger applicationof a mobile device, the method comprising: activating a chat userinterface to interface with an account of the image forming apparatuscorresponding to the image forming apparatus on the messengerapplication; sending user messages to control a printing function of theimage forming apparatus, which are input through the activated chat userinterface; and controlling the printing function of the image formingapparatus by communicating with the image forming apparatus in aconversational manner according to response messages of the account ofthe image forming apparatus in response to the input user messages. 15.The method of claim 14, wherein the user messages and the responsemessages are transmitted and received via a cloud server that managesthe image forming apparatus.
 16. The method of claim 15, wherein thecloud server comprises a bot server that communicates with a messengerserver providing a service relating to the messenger application andsends and receives the user messages and the response messages, whereinthe bot server receives the user messages from the messenger server andparses the received user messages to generate the response messagescorresponding to the received user messages.
 17. The method of claim 15,wherein the cloud server comprises a print service server that controlsand manages the image forming apparatus present on a network, whereinthe print service server controls the printing function of the imageforming apparatus to be activated and collects monitoring information ofa status of the image forming apparatus, based on the user messages. 18.The method of claim 14, wherein the sending comprises transmitting animage that is to be printed to the image forming apparatus when amessage comprising the image that is to be printed is input through theactivated chat user interface.
 19. The method of claim 14, wherein theactivated chat user interface is a chat window for chatting with theaccount of the image forming apparatus one-to-one, or a chat window forchatting with a cloud server that manages the account of the imageforming apparatus and accounts of other image forming apparatuses.
 20. Anon-transitory computer-readable recording medium having embodiedthereon a program to execute the method of claim
 14. 21. An imageforming system to control an image forming apparatus by using amessenger application, the image forming system comprising: a mobiledevice to activate a chat user interface to interface with an account ofthe image forming apparatus on the messenger application, and sendinguser messages to control a printing function of the image formingapparatus; a cloud server to receive the user messages from a messengerserver, providing response messages of the account of the image formingapparatus in response to the user messages, and communicating with themobile device in a conversational manner, thus controlling the printingfunction of the image forming apparatus; and an image forming apparatuswhose printing function is controlled by the cloud server based on theuser messages or providing monitoring information of a current status.22. The image forming system of claim 21, wherein the user messages andthe response messages are transmitted and received via a cloud serverthat manages the image forming apparatus.
 23. The image forming systemof claim 21, wherein the cloud server comprises a bot server thatcommunicates with the messenger server providing a service relating tothe messenger application and sends and receives the user messages andthe response messages.
 24. The image forming system of claim 23, whereinthe bot server receives the user messages from the messenger server andparses the received user messages to generate the response messagescorresponding to the received user messages.
 25. The image formingsystem of claim 21, wherein the cloud server comprises a print serviceserver that controls and manages the image forming apparatus present ona network.
 26. The image forming system of claim 25, wherein the printservice server controls the printing function of the image formingapparatus to be activated based on the user messages.
 27. The imageforming system of claim 25, wherein the print service server collectsmonitoring information of a status of the image forming apparatus basedon the user messages.
 28. The image forming system of claim 25, whereinthe print service server maps and registers identification informationof the image forming apparatus and a user account thereof by using a webserver provided by the image forming apparatus or a user interface panelof the image forming apparatus.